Radiometer with digital imaging system

ABSTRACT

A radiometer includes an integrally mounted digital camera aligned to image the energy zone of the radiometer. When digital photographs are taken they are time stamped and stored in memory. The images may be viewed on a viewer integrated into the radiometer digital camera system or downloaded to a computer for formatting or viewing.

BACKGROUND OF THE INVENTION

[0001] This application claims priority from provisional PatentApplication No. 60/364,993 filed Mar. 13, 2002 entitled radiometer WITHDIGITAL IMAGING SYSTEM and Provisional Patent Application No. 60/392,733filed Jun. 27, 2002 entitled radiometer WITH DIGITAL IMAGING SYSTEM bothof which are hereby incorporated by reference for all purposes.

[0002] Radiometers, or infrared thermometers, are used to remotelymeasure temperatures. The radiometer includes an infrared sensor andinfrared optics to form an image of a portion of a remote object, theenergy zone, on the sensor. The radiometer calculates the temperature ofthe imaged energy zone based on the intensity of the infrared radiationfocused on the infrared detector.

[0003] Various techniques exist to align the radiometer to measure aparticular portion, the energy zone, of an object. Some existingtechniques include optical alignment systems such as a telescope andlaser alignment systems that project a spot into the center of theenergy zone and/or a ring on an object that outlines the energy zone.

[0004] In an industrial or commercial setting, the results of themeasurements might be crucial to safety or product quality anddocumentation could be required for technical, customer service,marketing or legal purposes.

[0005] However, with current systems documentation can be sketchy and aserviceman or technician is required to document the measurements in aseparate location.

BRIEF SUMMARY OF THE INVENTION

[0006] In one embodiment of the invention, a digital camera andradiometer are integrated into a single housing which aligns theinfrared optics of the radiometer and the optics of the digital cameraso that the energy zone imaged by the radiometer in included in thefield of view of the digital camera.

[0007] In another embodiment of the invention, a controller, digitaltime keeping subsystem, and memory are coupled to the digital camera.When a digital photograph is taken the photograph and the time it wastaken are stored in memory.

[0008] In another embodiment of the invention, a viewer is integratedinto the housing and software is included for displaying stored digitalphotographs on the viewer.

[0009] In another embodiment of the invention, a computer interface isintegrated into the housing and software is included for downloadingstored images to a computer.

[0010] Other features and advantages will be apparent in view of thefollowing detailed description and appended drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

[0011]FIGS. 1A and B are perspective views of a radiometer-digitalcamera system;

[0012]FIG. 2 is a block diagram depicting components of an embodiment ofthe invention; and

[0013]FIGS. 3 and 4 are screen shots depicting formats for organizingand displaying digital photographs and information about the photographson a digital computer screen.

DETAILED DESCRIPTION OF THE INVENTION

[0014] Reference will now be made in detail to various embodiments ofthe invention. Examples of these embodiments are illustrated in theaccompanying drawings. While the invention will be described inconjunction with these embodiments, it will be understood that it is notintended to limit the invention to any embodiment. On the contrary, itis intended to cover alternatives, modifications, and equivalents as maybe included within the spirit and scope of the invention as defined bythe appended claims. In the following description, numerous specificdetails are set forth in order to provide a thorough understanding ofthe various embodiments. However, the present invention may be practicedwithout some or all of these specific details. In other instances, wellknown process operations have not been described in detail in order notto unnecessarily obscure the present invention.

[0015] In a preferred embodiment of the invention, a digital photographycapability is added to a radiometer product. The combinedradiometer-digital photography system will allow the user to capture avisual spectrum digital photograph of the target temperature measurementarea and the area surrounding it.

[0016] Thermal imagers provide a different type of output (IR image vs.visible light image). With the combined radiometer-digital photographysystem, the user will be able to see the area measured by the radiometerif the radiometer includes a laser-sighting system because the spotsgenerated by the laser sighting system will be visible in the digitalphotograph.

[0017] The user will have the potential to record and store ˜100photographs within the combined radiometer-digital photography systemthermometer, to be associated with the maximum 100-router positionsavailable in the radiometer. The date/time stamp of the reading will bealso included in the photograph, added by the radiometer software, andwill provide an additional dimension of credibility to the photographicimage.

[0018] One of the principle benefit to users of the digital photographyfeature is to insure the present quality of temperature inspections andto have a convincing, electronic documentation of the area measured andits temperature at a particular date and time. The photograph will giveindustrial users confidence that a temperature measurement was made ofthe correct area. Repair service and parts providers, either employed byequipment owners or contractors, will have solid documentation of thetemperature condition of an object in “before” and “after” repairstates. This documentation can be used for technical, customer service,marketing, and legal purposes. Because the photographs will be indigital form, they will have the potential advantages of being easilyincorporated in other documents, archived, and emailed. Markets wherethe invention can be advantageously employed include preventivemaintenance, (especially of electrical components where imager reportsare well established), electrical utilities, non-hazardous petrochemicallocations, and inspection services regulated by documentationrequirements.

[0019] An embodiment is depicted in FIGS. 1A and B, where the formfactor of the combined radiometer-digital photography system will bethat of an existing radiometer 10 having a pistol form factor with theaddition of a digital camera 12 mounted above. The digital camera 12extends the pistol form factor metaphor by appearing to be an opticalsighting scope. The digital camera does not need a viewfinder becausethe laser sighting system generates laser spots outlining the energyzone to ensure that a photograph of the energy zone is recorded. Theradiometer-digital camera system includes a control button interface 12including a data button 12 a, an LED 14, a viewing screen 16 which isdescribed in more detail below, an up down button 18, a trigger 20, anda USB connection 22. Images and temperature information can bedownloaded to a PC or other digital devices via a USB connection 22.

[0020]FIG. 2 is a high-level block diagram of a preferred embodiment.The digital camera 12, a controller 30, a memory subsystem 32 which holdprogram code modules for storing, displaying, and downloading digitalphotographs, a digital clock subsystem 34, and the output interface 22share data over a data bus. As is known in the art, FIG. 2 is highlyabstracted and the actual connections between the various elements canbe implemented in numerous ways. Additionally, control lines or acontrol bus (not shown) couple the controller to the various elements.

[0021] User Interface of a Preferred Embodiment

[0022] Display and LED: The unit display will use the existingradiometer display and LED, adding functionality. Photographs will berecorded simultaneously with temperature and date/time data as the userworks his way through the logger positions routing scheme.

[0023] Operational Overview

[0024] The basic concept of the combined radiometer-digital photographysystem is that a photograph will be taken in the same instant as atemperature reading with date/time stored in one of the 100 logpositions in the radiometer's memory. Temperature and image recordingwill occur as the trigger is released. A camera viewfinder is notnecessary since the laser sighting system will show the temperaturereading and the center of the photograph.

[0025] The camera memory must be able to hold at least as manyphotographs as the radiometer has log positions (one hundred) undercommon operating conditions. If there is insufficient non-volatilememory available in the radiometer, then deleting printer strings is thepreferred first choice for freeing additional memory. The system givesthe user easily understood “signals” to indicate if there is a problemwith the photograph due to low light and out of memory (describedbelow).

[0026] An important element of this embodiment is integration with theradiometer software. When the radiometer is connected via a USB port toa computer and the LOG mode is invoked, the photographic information isdownloaded from radiometer to the computer along with the loggerinformation. This data can be saved as a file. The tabular format of logtable information is depicted in FIG. 3 and includes thumbnail picturesof the digital photographs that are displayed along with the positionname, temperature, date/time, emissivity, and alarm information. It ispossible to see the full-size photograph by double-clicking on thethumbnail. Individual creation of digital (.jpg) files of eachphotograph with the date/time and position name superimposed must beeasily accomplished.

[0027] Another format is depicted in FIG. 4 where the photos only aredisplayed as thumbnails with each photo labeled with an identifier andthe measured temperature.

[0028] In another embodiment, the combined radiometer-digitalphotography system will include a digital-camera style viewer 16, forexample in the form of an LCD display, to allow the user to viewphotographs stored in memory directly on the radiometer. The viewer willbe able to scroll through all the pictures stored in memory and alsoview the current image being acquired. Thus, the user will be able tobetter align the camera based on the immediate view and also view allthe previous time-stamped images directly when using the combinedradiometer-digital photography system.

[0029] The camera will operate in continuous video display-in-a-windowmode when the combined radiometer-digital photography system isconnected to a PC in the radiometer's temperature monitoring mode.Photographs will be automatically stored with the monitored temperaturewhen a user-specified alarm condition is satisfied.

[0030] An integral flash unit for low light conditions can also beincluded.

[0031] Inspection Routing with Simultaneous Photographs

[0032] Features of a specific embodiment will now be described. At anytime, the user can see how many photographic “positions” have been usedout of the total potential by pressing the data button until a displayof the form “images: x/106” is shown and for an instant after taking ameasurement (see below).

[0033] The user will press the Data button once to enter Recall mode.Recall mode will allow the user to see previously stored temperaturevalues by pushing the up and down arrow buttons 18 to move betweenpositions. The positions may have been named with the radiometersoftware or could have generic names, i.e. “Loc 1”. The location nameand temperature value are displayed at the bottom of the display withthe “RCL” icon visible.

[0034] The user can either switch to Log mode by pushing the Data button12 a once more or to normal mode by pushing the Data button 12 a twice.Once in Log mode, the combined radiometer-digital photography system isready to simultaneously record temperature information with photographs(if the photography ability has not been switched off via the radiometersoftware). The ability to take photos can be switched on/off for eachused logger position during configuration of the device logger in theradiometer software (in Logger mode Setup). Independent of the Loggersetup, the camera function can be switched off using the buttoninterface of the combined radiometer-digital photography system to givea user in “low battery” situation the chance to finish the routing run.A photograph will be attempted upon trigger release. Given sufficientlight, the unit will signal successful storage of an image via two shortbuzzer “beeps” and flashing the LED in green mode and display themessage “images:x/106” for 2 seconds in the logger position location onthe display to show the amount of photos consumed.

[0035] If a photograph is not successfully recorded for either low lightor insufficient camera memory, there will a long beep and the LED willflash in red mode. If the problem in recording a photo is low light, thedisplay will show “Low Light” (same error message for camera movementproblems). If the camera is out of memory, it will display the message“Out of Memory” for 2 seconds. Then, The system will display “images:x/106” (shorthand for the amount of potential photographs remaining ofthe maximum number of photographs) for 2 seconds.

[0036] An implementation that cannot reuse camera memory except when thememory is totally cleared is possible. This means that that more thanone photo position in memory is consumed by one radiometer temperaturelogger position, creating the possibility of running out of photo memorybefore there is one photo for each of the combined radiometer-digitalphotography system's one hundred temperature logger positions. Thisbehavior is the reason that the user must be aware of the used andremaining photo positions in the camera's memory.

[0037] If the camera successfully records an image, the routing positionwill advance to the next position and remain in log mode. If no photowas recorded, the position will not advance, giving the user anotheropportunity to record an image and temperature. The system will remainin Log mode until the Data button is pushed again and it returns tonormal mode.

[0038] Download of Photographs and Temperature Information

[0039] The user connects the combined radiometer-digital photographysystem to a computer using a standard USB cable. USB is the protocolbecause of its ubiquity on laptops and because it is fast enough todownload one hundred quarter VGA sized images quickly. The user willthen invoke the version of the radiometer software that has beenmodified to support the combined radiometer-digital photography system.The user will be able to set a default mode in the Setup menu in thesoftware to automatically download the images associated with eachlogger position or to query at each download. The user will also be ableto set clearing of the combined radiometer-digital photography system'scamera and temperature as a default option to perform this taskmanually. Thumbnail images will display in a new column of theradiometer logger mode matrix as depicted in FIG. 3. The user will beable to zoom the image to 100% by clicking on the thumbnail. This actionopens a standard Windows window with standard controls, e.g. maximize,minimize, close, title bar. By right clicking on the full size photo,the user will be able to save the image to another file in .jpg format.

[0040] The user will be able to create a report page in .doc (MS Word)format of the information pertaining to a row (position) in theradiometer software. The user will be able to choose among report pagetemplates in the Setup menu. At least an electrical maintenance reporttemplate and a generic reporting template will be supplied with theradiometer software. These templates will accommodate user-customizedheaders and placement of the logger position data. The basic concept isthat a program (can be Word macro or VBA) will “place” the temperatureor photographic data in forms defined by the user or included with thesoftware. Each field in the radiometer logger data table is exportableto the report templates. For instance, the temperature information inthe .lgg file for a position is exportable to &temp field in thetemplate; the emissivity field is placed in &emissivity, the photographto &photo, etc. Revisions of this document will have drawings of thereport format template(s).

[0041] Software Installation

[0042] Standard Window installer software automates the installation ofradiometer software produce a fully compliant installation (withstandard Windows practices). Standard installation establishes programgroups and icons on the Program menu. Uninstall functionality isprovided.

[0043] Temperature Monitoring Mode

[0044] The system will add to the capabilities of radiometer's“Temperature” mode, the mode that measures and records temperature inreal time. A window is added to this screen that displays real timevideo so that the user will be able to see the object being measuredconcurrently with the temperature display. A menu item is added to allowthe user to specify software alarm, high, low, and delta T. The user canspecify a minimum interval between photographs. If an alarm condition issatisfied when radiometer is recording data, a photograph with a dateand time stamp will be recorded. This ability to allows users thepossibility of seeing a physical change in the object under measurement.

[0045] Summary of Features Included in Various Embodiments

[0046] 1. Download of all data, including images, from the combinedradiometer-digital photography system to PC in less than 15 seconds

[0047] 2. Images at least ¼ VGA size (160X120) and 16 pixels deep,Switchable to full VGA and one fourth the number of photos viaradiometer software.

[0048] 3. Camera field of view for normal focus 6 mm focal length, closefocus also 6 mm. This is fairly wide angle to show more context of theobject measured, gain more light and have larger depth of field.

[0049] 4. Photos retained in the combined radiometer-digital photographysystem for minimum 60 days with new batteries and no use.

[0050] 5. “Generous” low light conditions, similar to light capture off1.8 lenses for 35 mm camera. 10 lux.

[0051] 6. PC must be available for program startup and other functionswithin 5 seconds of USB connection of the combined radiometer-digitalphotography system.

[0052] 7. The .lgg file must be printable with the thumbnails.

[0053] 8. Date/Time stamp and location name should be included in theimage

[0054] 9. Double-clicking on the thumbnail of the image in radiometershows it at full size in a standard Windows window including Close,Minimize, and Maximize. Right click in the image pops up a menu to printout a full image from radiometer and also allows specification of theimage numbers (range) in the print dialog. The menu also allows exportto a .jpg file.

[0055] 10. A comment field of 32 characters should be displayed in theradiometer logger table to be interactively edited. This is for usercomments like “motor recently lubricated” (which are not found in the MXunit but only in the *.lgg file)

[0056] 11. Must be a “No camera” mode setting with the Mode button tosave battery power 12. Logger positions will show an indication on theMX display of a photo associated, for example, an asterisk (*).

[0057] 13. Radiometer software will allow the user to draw, optionally,a simulated sighting circle in the image. This option would be usefulfor photos where the laser circle is not easily visible and the distanceis far enough to avoid the most severe parallax effects of the offsetmounting of the camera. The drawn circle must be clearly distinguishablefrom a photographed laser alignment system generated circle.

[0058] The invention has now been described with reference to thepreferred embodiments. Alternatives and substitutions will now beapparent to persons of skill in the art. For example, the utility of theinvention is not restricted to any particular radiometer form factor.Further, the particular details of formatting report documents is notcritical to practicing the invention. Additionally, the particularcontrol interface described is not critical to practicing the inventionand other control interfaces, such as voice activation, can be utilizedas is known in the art. Accordingly, it is not intended to limit theinvention except as provided by the appended claims.

What is claimed is:
 1. A temperature measuring system comprising: aradiometer that remotely measures temperature based on emitted infraredradiation with the radiometer including an infrared sensor and infraredoptics for focusing infrared radiation emitted by an energy zone on theinfrared sensor; a digital camera for creating a digital image of anobject located in a field of view of the digital camera; a housing forenclosing and aligning the digital camera and radiometer so that thefield of view of the digital camera includes the energy zone imaged onthe infrared sensor; a viewer, integrated into the housing, fordisplaying images generated by said digital memory; a digital timegenerating subsystem; a control interface; a controller and memorylocated within the housing, with the memory storing image storingprogram code which, when executed by the controller in response to thecontrol interface, causes a digital photograph to be taken and to bestored in memory with a time stamp indicating when the digitalphotograph was taken.
 2. The system of claim 1 with the memory furtherstoring image display program code which, when executed by thecontroller in response to the control interface, causes a stored digitalphotograph to be displayed on the viewer.
 3. The system of claim 1further comprising: an output interface for connecting with an externalcomputer; and with the memory further storing image downloading programcode, which when executed by the controller in response to the controlinterface, causes a stored digital photograph to be output from theoutput interface.
 4. The system of claim 1 where the housing is formedof a first part holding the radiometer, display, and control interfaceand second part holding the digital camera, the first and second partsattached to form a single housing.
 5. A temperature measuring systemcomprising: a radiometer that remotely measures temperature based onemitted infrared radiation with the radiometer including an infraredsensor and infrared optics for focusing infrared radiation emitted by anenergy zone on the infrared sensor; a digital camera for creating adigital image of an object located in a field of view of the digitalcamera; a housing for enclosing and aligning the digital camera andradiometer so that the field of view of the digital camera includes theenergy zone imaged on the infrared sensor; an output interface forconnecting with an external computer; a digital time generatingsubsystem; a control interface; a controller and memory located withinthe housing, with the memory holding image storing program code which,when executed by the controller in response to the control interface,causes a digital photograph to be taken and to be stored in memory witha time stamp indicating when the digital photograph was taken and thememory holding image downloading program code, which when executed bythe controller in response to the control interface, causes a storeddigital photograph to be output from the output interface.